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ABSTRACT 

Second-order,  linear,  recursive,  fixed-weight  optimal  and  critically 
damped  filters  are  compared  on  the  basis  of  truncation  errors  produced  by  each, 
nie  critically  damped  and  optimal  filters  are  derived  along  with  the  commonly 
used  parameters  which  are  truncation  error  and  noise  ratio.  It  is  shown  that 
when  truncation  errors  are  compared  on  the  basis  of  equal  noise  ratios  for  the 
two  filters,  the  optimal  filter  yields  a  significant  improvement  over  the 
critically  damped  filter. 
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It  is  noteworthy  that  and  bj  are  given  in  terms  of  the  we’r  ts  G,  H,  and  K, 
and  M  and  N  are  both  three. 

The  z-transform  of  Equation  (7)  may  now  be  taken. 

=  X^(z)  [  (G  +  H  +  K)  +  (-2G  -  H  +  K)z-'+  Gz-‘^]/[l 

+  (-3+  G  +  H+  K)z-’+  (3  -  2G  -  H  +  K)z-^  +  (-1  +  G)z"^)  . 

(9) 


2.  Optimum  Second-Order  Filters 

From  Equation  (9)  the  relations  among  the  weights  of  a  critically 
damped  second-order  filter,  may  be  obtained.  For  a  second-order  filter  to  be 
critically  damped,  the  three  roots  of  the  denominator  polynomial  must  be  real 
and  equal.  The  three  weighting  coefficients  (G.  H,  K)  are  functions  of  the 
roots  (r  1,  Tj,  rs)  of  the  denominator  polynomial. 

A  term,  /3,  may  be  defined  as  follows: 


where  r  is  the  real  root  of  the  denominator  polynomial.  The  weights  are  related 
to  r  (and  0)  by  equating  the  coefficients  of  like  powers  of  z*'  in  the  cubic 

*  ”  r)^,  to  those  of  the  denominator  polynoniial.  The  resulting  equations  are: 

G  =  I.  0  -  /I* 

H=  1.5(1 
K  =  0.  5(1  -  /?)’  . 

It  can  readily  be  shown  that  /?  is  a  good  indication  of  the  degree  of  smoothing. 

No  smoothing  will  take  place  if  (?=  0,  and  heavy  smoothing  will  take  place  as 
0  approaches  1.  Therefore,  many  0'8  may  be  chosen  between  zero  and  one, 
and  the  critically  damped  weights  solved  for.  The  relationship  between  the 
weights  may  be  seen  in  upper  case  letters  in  Figure  1. 

Emphasis  will  now  be  shifted  toward  deriving  a  Kalman  steady-state 
filter  from  which  the  weights  will  be  computed  for  the  optimum  second-order 
filter.  To  begin  with,  certain  parameters  must  be  known  in  order  to  initiate 
the  process.  One  of  these  parameters  characterizes  the  expected  maneuver 
of  the  target.  It  should  again  be  pointed  out  that  the  filter  operates  on  only  one 
measured  coordinate  at  a  time,  for  example,  range.  Therefore,  a  maneuver 
covariance  matrix,  Q,  such  that 
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0  0  0 


Q=  0  0  0  ,  (10) 

M 

may  be  defined. 

Element  Q33  of  this  matrix  actually  the  maneuver  variance.  It 

represents  the  uncertainty  in  predicted  acceleration  caused  by  derivatives  In 
the  trajectory  higher  than  the  second,  during  one  sample  Interval.  Element  Q33 
may  be  approximated  from  the  maximum  target  jerk  by  neglecting  derivatives 
higher  than  the  third.  If  the  maximum  jerk  of  a  target  Is  5  g  per  second, 
this,  multiplied  by  T,  might  be  taken  to  be  the  3a  maneuver  and  when  broken  down 
Into  its  coordinate  components,  one  of  which  Is  the  filter  Input,  a^^*  Is 
obtained. 

Also  a  sampled  data  system  transition  matrix  for  a  constant  acceleration 
Input  must  be  defined.  It  Is: 


From  Schwarz  and  Frledland  [1]  [Section  4.2,  page  107,  Equation  (4.5)]  $(t) 
Is  defined  as: 

4>(t)  =  I+  .\t  +A*^+  A^|-+  ... 

However  since 

y  =  constant 

then 

y  =  0  . 

Therefore,  Equation  (4.3)  In  the  reference  becomes: 

y(t)  =>  Ay(t)  , 
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And  from  Equation  (4.  5) .  with  I  =  the  Identity  matrix. 


Therefore 


1 

0 

o' 

0 

1 

0 

0 

0 

1 

*(T)  = 

0 

1 

0 

+ 

0 

0 

1 

T  + 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

10  0 

0  to" 

1 

o 

o 

’I’i 

tz’ 

^  T  ^ 

$(T)  = 

0  1  0 

+ 

0  0  T 

+ 

^  o 

o 

o 

2 

0  1  T 

0  0  1 

0  0  0 

0  0  0 

0  0  1 

How,  two  other  matrices  are  defined  which  wUl  be  used  later; 


W  = 


W, 

Wj 


Is  the  second  order  filter  "weighting"  matrix; 


(12) 


H=  [1 


OJ 


(13) 


Is  termed  the  observation  matrix  and  relates  the  state  vector  [Yl  to  the 

lXT"»r‘  ''"T"  observation  matrix 

Indicates  the  number  of  ways  one  Intends  to  measure  Independently  a  state 

variable  such  as  position.  A  non-zero  element  indicates  what  variable  or 
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variables  are  being  measured.  The  number  of  columns  corresponds  to  the 
number  of  rows  in  the  state  vector.  Therefore,  It  can  be  seen  that  since  the 
only  input  is  position  [Xj] ,  being  measured  in  only  one  way,  the  observation 
matrix  is  defined  as  in  Equation  (13). 

There  are  two  other  matrices  which  must  be  defined.  These  are  the 
smoothed  error  covariance  matrix  and  the  predicted  error  covariance  matrix. 


where  Pj,  is  the  predicted  position  covariance,  or 

P„=  E[  (y  -  Ey)  (y  -  Ey)|  =  E|  (y  -  Ey)^]  , 

^here  E  denotes  the  expected  value.  Therefore,  each  of  the  elements  of 
P.  ,,  is  defined  (but  not  calculated)  as  follows: 

Pa=  E[(y  -  Ey)  (j)  -  E^^)] 

Po=E[(y-Ey)(y-Ey)) 

P23=  E(  (y  -  Ey)  (y  -  Ey)) 

P22  =  E(  (y  -  Ey)  (y  -  E>^)]  =  E[  (j^  -  E^)^] 

P33=  E|  (y  -  Ey)  (y  -  Ey))  =  E(  (y  -  Ey)2j  . 

The  same  is  true  for  P  excepting  the  fact  that  (*)  is  replaced  by  (-).  Note 

—  /\ 

at  this  point  that  the  matrices  P  and  P  are  symmetrical  about  the  main  diagonal. 
This  wdll  be  a  major  simplifying  factor  brought  out  later. 

Now  the  Kalman  sequence  and  the  general  Kalman  equations  for  a 
second-order  filter  may  be  introduced.  Once  again  the  symbol  (“)  means 
predicted  and  I-)  means  smoothed  quantities.  The  genera!  equation  for  deter¬ 
mining  weights  is 

W(n+1)  =  P(rH-l)  [h  P(tM-lhH^+ r]  .  (14) 

All  matrices  except  the  measurement  variance  have  been  defined: 


6 


where  (7^^  Is  the  standard  deviation  of  the  radar  errors.  Thus  R,  In  this  case 
is  a  1  X  j  matrix. 


The  other  two  equations  needed  to  update  the  covariances  and 
the  weights  are: 


calculate 


P(m-l)  =  [I  -  WHJ  P(iH-l) 
P(n+1)  =  ♦  P(n)  4.^’+  Q  . 


(16) 

(17) 


Equations  (16)  and  (17)  will  be  combined  to  form  the 
for  the  predicted  state: 


error  covariance  matrix 


P(m-l)  =  *  (I  -  Will  P(n)  +  Q 


(18) 


The  above  equation  may  be  written  in  expanded  matrix  form  and  the  matrix 
algebra  carried  out,  since  all  the  matrices  have  been  defined: 
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(19) 

‘I  becomes  advantageous  to  get  explicit  expressions  for  the 
weights.  From  Equation  (14): 


A  A 

-  • 

• 

W(nfl)  = 

P„(IH-1)  P|3(n^l)  Pb(ihI) 
P„(>H-1)  @j,(i>fl)  ?a(iHl) 

^  A  A 
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0 
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0 

Therefore, 


'Wi(nfl)' 

P„(n+l)/[P„(tw-l)  +  R]' 

W(nfl)  = 

Wjfn+l) 

= 

Pi2(n+l)/fP,,(m-l)  +  RJ 

_Wj(nfl)_ 

_PB(nfl)/[P„(m-l)  +  R] 

It  Is  now  apparent  that: 


W,(n+1)  =  Pij(n+l)/[P„(rHl)  +  R] 
Wj(nfl)  =  P,2(nfl)/fP,i(rM-l)  +  R] 
W3(n+1)  =  Pn(wi)/(p„(m.i)  +  R]  . 


(20) 


(21) 

(22) 

(23) 


These  three  equations  may  be  used  quite  extensively  In  simplifying  the  equations 
which  result  from  expanding  Equation  (19).  It  may  now  be  shown  from 
Equation  (19)  that: 

Pn(nM)  =  W,R  +  2Wj  RT  +  W,  RT*  -  P,j(„)  Wj  -  W3Pa(n)T» 

+  P22(n)  T*+  P23(n)T’-|  Po(n)  W3T‘+  |  P3,(n)  T* 

P,2(nfl)  =  W2R+  W3RT  -  P,j(n)  W2T+  P22(n)  T  +  I  P23(n)T^ 

--P,2(n)  WT!'-|pB(n)  W3T3  +  |p33(n)  t’ 

Pn(nfl)  =  W3R-  P,3(n)  WjT  +  P33(n)T  +  |  P33(n)T>' -  |  Pn(n)  WjT* 

(26) 

P22(rH-l)  =  -  Pgfn)  W2+  P22(n)  +  2  P23(n)  T  -  2  P,2(n)  W3T 

”  Pfl  (•*)  Pjj  T*  (27) 

Pssfnfl)  =  -  Pgfn)  W3  +  P33(n)  +  (28) 

P23(im-1)  =  -  P,j(n)  W,  +  Pjjfn)  -  p^fn)  W3T  +  P33(n)T  .  (29) 

In  the  steady  state  the  covariance  and  weights  approach  constants.  Since  this 
Is  true. 


(24) 


(25) 
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P,.(rH-l)  =  Py(n)  , 

1”S.‘ «.««.  Cx  <,p«n,.„ 
3.  Relationship  Bctwetn  Optimum  and  Critically  Damped  Filter 

P's  which  cannot  ho  Hoc/.  <u  j  i  ®  "^2'  by  eliminating  the 

P'.  »>.«  ™  Imi't 

T  (-2T)  and  Equation  (26)  by  T  iqu.r.'d  (Th  ^d 

c.»b,„.d.  Fto„  Equation.  ,22),  and’^a,  ,t  tLt'Sjy  ^7lTh.r 


2TW,.W|^W,tW,TfW,|!) 


Considering  Equations  (26)  and  (27)  in  a  similar 
equation; 

2W,W3  , 

Now  Equation  (28)  easily  reduces  to: 


(30) 

manner,  one  may  deduce  the 

(31) 


"3 

1-W, 
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(32) 


d.,orlbIS’G.H’K'"TtTt'  ">  •»  “»  PP»«»«Ir 

oontrolTc  J)L  ■«><«W"E«d  prodlotlon  aquation.  (.Itb  no 


[Y(nfl)]  =  f$]  |Y(n)] 

lY(n)]  =  [?(n)J  +  fwj  (fX(n)J  -  [Hj[9(n)j} 

y(n+l)  =  y(n)  +  y(n)T+  y(n)  y 
y(in-l)  =  y(n)  +  y{n)T 
y(nfl)  =  y(n) 
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y  (n)  =  y(n)  +  W,[  x(n)  -  y  (n)  J 
y  (n)  =  y(n)  +  W2[  x(n)  -  y(n)] 
y(n)  =  y(n)  +  W3[  x(n)  -  yrn)  ]  . 

Thus  It  becomes  apparent  that  the  following  relationships  hold  true  for  optimum 
steady-state  second  order,  and  critically  damped  second-order  filters: 

W,=  g  (33) 

WjT^h  ,34) 

•  (35) 

Weights  (optimum)  h  and  k  are  shown  as  functions  of  g  in  lower  case 
letters  In  Figure  1.  Shown  in  Figure  2  is  a  curve  relating  the  optimum  weight 
a  ^ 

g  to  the  parameter  ^ .  Thus,  the  weights  for  the  optimum  filter  are  fixed 
R 

If  T,  a  ,  and  a  are  known, 

M  R 

In  summary,  there  is  actually  no  difference  in  the  critically  damped  and 
the  optimum  filters  except  In  the  calculation  of  the  weights. 

4.  Variance  Reduction  Ratio 

Attention  is  now  turned  to  the  criteria  to  be  used  in  comparing  the  two 
second-order  filters.  It  can  be  shown  that  there  exists  a  variance  reduction 
ratio,  6\  which,  for  predicted  position,  is  a  function  only  of  the  weights  of  the 
second-order  filter.  This  function  is  defined  as  follows : 

52  _1L _  gk(2g+  h  -  4)  -t-  h  [g  (2g+  h)  +  2hl 

[-g(h+ k)  +  2kJ  (2g+ h  -  4) 

where  a-*  and  are  the  variances  of  the  output  and  the  input  respectively. 

The  actual  step-by-step  derivation  of  this  term  Is  beyond  the  scope  of  this 
paper,  however,  the  procedure'  will  be  pointed  out.  Using  Equations  (1)  through 
(6),  one  may  solve  for  every  element  of  the  covariance  matrix  with  the  weights 


'C.  F.  Asquith,  unpublished  notes. 
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constant  by  calculating  E[  (y  -  Ey)*] .  E|  (y  -  Ey)  (y  -  Ey)  J ,  etc.  Then  the' 
Indexes  may  be  dropped,  making  the  steady-state  assumption.  Next,  Pjj,  P^, 
Pj2*  1*23,  and  Pjj  must  all  be  eliminated,  leaving  an  equation  for  Pd/R  which  la 

actually  for  predicted  position  only.  (The  same  procedure  may  be  followed 

X 

If  the  variance  reduction  ratio  Is  desired  for  either  velocity  or  acceleration. ) 

Therefore,  by  simply  knowing  the  .weights,  one  may  calculate  the  noise 
ratio  of  the  two  filters.  The  noise  ratio,  6^,  for  the  two  filters  may  then  be 
equalized  and  the  filters  may  be  compared  on  other  grounds. 


5.  Tnineotion  Error 

The  crltei-ion  that  has  been  choser  .or  comparison  of  the  two  filters  la 
an  error  which  arises  from  the  Inputting  to  the  two  filters,  of  a  curve  of  one 
*gree  higher  than  the  order  of  the  filter.  In  the  case  of  the  second-order 
filter,  this  would  be  an  Input  comprised  of  a  change  In  acceleration  (x ;  or 
"jerk.  "  When  this  is  Input  Into  a  second-order  filter,  the  steady-state  error 
which  arises  is  termed  truncation  error. 

Assuming  a  trajectory  with  constant  jerk  (Jo) ,  the  acceleration, 
velocity,  and  position  can  be  calculated  as  functions  of  time.  The  acceleration 
equals  the  total  time  times  the  jerk  or: 


Acceleration  =  nT  Jj  . 

Integrating  this  expression,  the  velocity  and  position  are  obtained: 

Velocity  =  ^  J„ 
nT® 

Position  =  ^  Jo  . 


(36) 

(37) 

(38) 


The  noise-free  measured  values  at  times  n,  n-1,  and  n-2  are  denoted  as: 


-  nT*  , 

n"  6 

(39) 

(n-l)>  T®  _ 

*n-l  ■  6  •'<' 

(40) 

(n-2)’  T’ 

n-2  6  ■ 

(41) 
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Now  the  equation  for  linear  feedback  filters.  In  this  case,  Equation  (7)  Is 
recalled: 

y  (n+1)  =  (g  +  h  +  k)  +  (-2g  -  h  +  k)  ^ 

V2-  <-3+g+h+g) 

-  (3  -  2g  -  h  +  k)  y^_j  -  (-1  +  g)  (7) 

The  errors  then,  In  the  predicted,  are  defined  for  the  present  point  and  the 
past  three  as: 


e(nH)  =y(n+l)  . illtliillijl. 

6 

(42) 

,  .  T’  Jj 

e(n)  =  y(n)  - - - - 

(43) 

e(n-l)  =y(n-l)  -  4-- 

6 

(44) 

€  (n-2)  =  y  (n-2)  -  T’  J,, 

6 

(45) 

Solving  Equations  (42)  through  (45)  for  the  respective  y's  and  substituting  them 
In  Equation  (7),  one  obtains: 

€(ih-1)+  (i>fl)’T’^=  (g+h  +  k)(nT)’^+  (-2g  -  h  +  k)  (n-1)®  T* ^ 

+  g  (n-2)’  T*"  y  -  (-3  +  g  +  h  +  k)  ^e(n)  +  n’ t’  -  (3  -  2g  -  h  +  k) 

j^c(n-l)  +  (n-1)*  -  (-1+  g)  ^e(n-2)  +  (n-2)®  T®  . 

Simplifying,  the  previous  equation  becomes: 

2k  e(n+l)  =  T®  y  (-(n+l)’+  (g+  h+  k)  n’ +  (-2g  -  h  +  k)  (n-1)® 

+  g(n-2)’-  (-3  +  g+h+k)  n’-  (3  -  2g  -  h  +  k)  (n-1)’ -  (-1  +  g)  (n-2)’]  , 
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Therefore: 


2k  e(iH-l)  =  (-(tH-l)»+  3  n^-  3(n-l)3+  (n-2)3] 

Finally  the  equation  reduces  to: 

2k  €(nfl)  -  f6]  ^  -  T®  J|,  , 


Thus: 


e(iH-l)  = 


-T^  Jn 
2  k  • 


In  summary,  the  truncation  error  la  a  function  of  ^  .  Therefore,  in  order  to 
minimize  truncation  error,  k  must  be  maximized. 

Now  the  filter  weights  must  be  chosen  so  that  the  noise  ratios  of  the  two 
filters  carresp<md.  Then  the  truncation  errors  of  the  two  filters  can  be  com¬ 
pared  to  determine  which,  the  critically  damped  or  the  optimum,  has  less 
truncation  error  from  the  constant  jerk  input  (Figure  3). 


6.  Conclusions 

It  is  readily  apparent  that  the  optimum  filter  offers  a  far  better 
minimization  of  truncation  error  than  the  critically  damped  filter.  In  fact, 
choosing  a  certain  noise  reduction  ratio  one  may  determine  from  Figure  3  that 
there  is  approximately  a  40-percent  decrease  in  truncation  error. 

It  must  be  noted  that  the  truncation  error  due  to  those  inputs  of  two  or 
more  degrees  higher  than  that  of  the  second-order  filter  have  been  neglected. 
These  derivatives  generaUy  are  of  little  significance,  however,  in  the  calcula¬ 
tion  of  total  truncation  error  because  these  inputs  would  be  very  small  and  of 
short  duration. 

Therefore,  in  closing,  if  the  problem  is  to  minimize  truncation  error, 
there  is  a  marked  advantage  in  using  the  optimum,  second-order  filter  over  the 
critically  damped  second-order  filter.  Applicable  data  and  discussion  have  been 
given  in  previous  works  [2-4], 
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FIGURE  3.  CRITICALLY  DAMPED  AND  OPTIMUM  FILTERS:  TRUNCATION  ERRORS 
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